Skip to content

[v26.1.x] rpc: derive requests_pending gauge from _correlations#30294

Closed
Copilot wants to merge 2 commits intov26.1.xfrom
copilot/manual-backport-30264-v26-1-x-396
Closed

[v26.1.x] rpc: derive requests_pending gauge from _correlations#30294
Copilot wants to merge 2 commits intov26.1.xfrom
copilot/manual-backport-30264-v26-1-x-396

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Apr 24, 2026

Backport of PR #30264

The vectorized_rpc_client_requests_pending gauge was observed drifting over time (occasionally reporting values near UINT32_MAX). The manual _requests_pending counter had increment/decrement imbalances across error paths.

Replace it with _correlations.size(), which tracks in-flight requests by construction and cannot drift.

Conflict resolution: v26.1.x uses operator<< for client_probe formatting vs format_to on dev.

Backports Required

  • none - this is a backport

Release Notes

Bug Fixes

  • Fixed the vectorized_rpc_client_requests_pending gauge drifting over time.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • dl.google.com
    • Triggering command: /usr/lib/apt/methods/https /usr/lib/apt/methods/https (dns block)
  • releases.bazel.build
    • Triggering command: /home/REDACTED/bin/bazel bazel --version (dns block)
    • Triggering command: /usr/local/lib/node_modules/@bazel/bazelisk/bazelisk-linux_amd64 /usr/local/lib/node_modules/@bazel/bazelisk/bazelisk-linux_amd64 build //src/v/rpc:rpc (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

The manual counter was observed drifting over time. Replace it by
reading `_correlations.size()` directly, which tracks the in-flight
request count by construction and cannot drift.

(cherry picked from commit 29cd963)

Agent-Logs-Url: https://github.com/redpanda-data/redpanda/sessions/3905e3af-51cd-4562-9ecc-1bf9845e5275

Co-authored-by: nvartolomei <543193+nvartolomei@users.noreply.github.com>
Copilot AI changed the title [WIP] [v26.1.x] Rpc: derive requests_pending gauge from _correlations [v26.1.x] rpc: derive requests_pending gauge from _correlations Apr 24, 2026
Copilot AI requested a review from nvartolomei April 24, 2026 17:24
@andrewhsu
Copy link
Copy Markdown
Member

@nvartolomei curious to know how this PR compares to the workflow changes i just added in PR #30290 to create similar backport PR #30295

if copilot triggered backports are easier by assigning to the github issue, i can revert my PR #30290

@nvartolomei
Copy link
Copy Markdown
Contributor

nvartolomei commented Apr 24, 2026 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[v26.1.x] rpc: derive requests_pending gauge from _correlations

3 participants